Principle of Minimum Discrimination Information and Replica Dynamics
نویسندگان
چکیده
منابع مشابه
Principle of Minimum Discrimination Information and Replica Dynamics
Dynamics of many complex systems can be described by replicator equations (RE). Here we present an effective method for solving a wide class of RE based on reduction theorems for models of inhomogeneous communities. The solutions of the RE minimize the discrimination information of the initial and current distributions at each point of the system trajectory, not only at the equilibrium, under t...
متن کاملMinimum Dynamic Discrimination Information Models
In this paper, we introduce the minimum dynamic discrimination information (MDDI) approach to probability modeling. The MDDI model relative to a given distributionG is that which has least Kullback–Leibler information discrepancy relative to G, among all distributions satisfying some information constraints given in terms of residual moment inequalities, residualmoment growth inequalities, or h...
متن کاملThe Minimum Information Principle for Discriminative Learning
Exponential models of distributions are widely used in machine learning for classification and modelling. It is well known that they can be interpreted as maximum entropy models under empirical expectation constraints. In this work, we argue that for classification tasks, mutual information is a more suitable information theoretic measure to be optimized. We show how the principle of minimum mu...
متن کاملLanguage model adaptation using minimum discrimination information
In this paper, adaptation of language models using the minimum discrimination information criteria is presented. Language model probabilities are adapted based on unigram, bigram and trigram features using a modified version of the generalized iterative scaling algorithm. Furthermore, a language model compression algorithm, based on conditional relative entropy is discussed. It removes probabil...
متن کاملThe diffusion equation and the principle of minimum Fisher information
It is shown that the diffusion equation and its adjoint (time reversed) equation can be derived with only a few assumptions, using an information-theoretic approach based on the principle of minimum Fisher information. PACS: 05.40.+j; 89.70.+c
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2010
ISSN: 1099-4300
DOI: 10.3390/e12071673